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Abstract 

Aim: The analytic quality of cardiac biomarkers were investigated consecutive six months by sigma metric method in our emergency laboratory. Total allowable 
error ratio (TEa%)’s of AAB, BV, RCPA, Ricos, and Rilibak were used for calculation. Sigma levels are compared and used to decide which TEa% is appropriate for 
our laboratory for more accurate results. Material and Method: Sigma levels were calculated for cardiac biomarkers which include Troponin | (cTnl), Troponin 
T (cTnT), CKMB mass, Myoglobin (Mb) and NT-proBNP in our emergency laboratory department between December 2017 and May 2018. The internal quality 
control (IQC) and external quality control (EQC) assessment results and TEa%’s of AAB, BV, RCPA, Ricos, and Rilibak were used to calculate sigma metrics. 
The sigma metrics for tests were calculated by “Sigma = (TEa% - Bias%) / CV%” formula. Results: Considering different TEa% ‘s, it is evaluated that CKMB 
mass sigma level is at the “world-class quality”. On the contrary, cTnT sigma level is found to be at the level of “poor quality”. For AAB, BV, RCPA, Ricos and 
Rilibak, different sigma levels are observed. Discussion: Due to using different TEa%’s for each test, different sigma levels were determined. On the other hand, 
because of the “poor quality” level of cTnT sigma value, decision is taken for the improvement of cTnT in our laboratory. In addition, it is observed that there 
is no specified TEa% for whole blood samples. Therefore, it is concluded that, for more accurate and consistent evaluations, specified matrix of TEa% values 
are required for whole blood samples. 
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Introduction 

Accurate, precise and rapid test results are requested from 
emergency laboratories. Particularly, it is vital for the manage- 
ment of cardiac diseases such as acute coronary syndromes 
(ACS) and heart failure (HF). Cardiac biomarkers are valuable 
for the risk assessment of cardiovascular disease, as well [1, 2]. 
Radiometer AQT90 Flex allows receiving very quick (within ap- 
proximately 11-21 min) cardiac biomarker results. The meth- 
odology of analysis relies on detection of monoclonal antibod- 
ies in the analyzer. CKMB mass, Myoglobin (Mb), NT-pro BNP, 
Troponin | (cTnl) and Troponin T (cTnT) in the whole blood are 
detected rapidly with this analyser. By this way, early detection 
of cardiac damages becomes possible. 

Quality of preanalytical, analytical and postanalytical process 
is significant for the correct test results in laboratories. For 
quality of analytical process, each test is confirmed daily, with 
internal quality reference materials before analysis of patient’s 
samples. Additional to daily controls, external quality assess- 
ments are performed every month. This confirmation methodol- 
ogy allows laboratories to compare their results with the same 
reference material and get aligned for the results. 

Sigma metrics are calculated using internal quality control (IQC) 
and external quality control (EQC) data. And this simple calcula- 
tion method allows laboratory experts to interpret analytical 
quality level of the test results. Sigma methodology shows the 
degree of process accuracy and stability in terms of quality. 
Processes having 4 sigma level are accepted as representing 
“average quality performance” with 63 defects per million, 6 
sigma level is accepted as “the best” or “world-class quality” 
of performance with 0,002 defects per million [3,4]. Increase 
in sigma levels expresses reliable and better quality of test re- 
sults. While sigma levels are calculated, total allowable error 
ratio (TEa%)’s are used. TEa% _ is a simple comparative quality 
concept used to define acceptable analytical performance same 
as IQC and EQC outcomes. TEa% defines maximum error limi- 
tation for running test in the laboratory. For each test, we may 
compare different TEa%’s from different references. It is impor- 
tant to decide which TEa% is appropriate for our laboratory. 
In this study, TEa%s of American Association of Bioanalysts 
(AAB), 2004 update of the Spanish Society of Clinical Chemistry 
and Molecular Pathology table of desirable quality specifica- 
tions based on Biological variation (BV), 2012 update of the 
Royal College of Pathologists of Australasia and the Austral- 
asian Clinical Biochemist association Quality Assurance Pro- 
gram (RCPA), Ricos and Rilibak were used to calculate sigma 
metrics. In this manner, the analytic quality of Radiometer 
AQT90 Flex cardiac biomarkers are investigated consecutive six 
months in our emergency laboratory by sigma metric method. 
Especially, the study was conducted to determine which TEa% 
is appropriate for our laboratory and perform improvement 
studies for poor quality tests. 


Material and Method 

The IQC and EQC data of 5 cardiac biomarkers of the emergen- 
cy laboratory department between December 2017 and May 
2018 were used to calculate sigma levels. The AQT9O FLEX 
(Radiometer) analyzer was used to measure cardiac biomark- 
ers which include cTn |, cTn T, CKMB mass, Mb, and NT-proBNP. 


Two levels of internal control materials were obtained from 
Technopath Multi-check cardiac normal level-IQC1 and patho- 
logic level-lIQC2 (reference number: 944-513, 944-514). They 
were assayed once a day, two levels in the morning at 08:00 
a.m. l|QC data were used to calculate mean, standard deviation 
(SD) and coefficient of variation (CV)% of the tests separately 
for each month. CV% of the test were calculated with “CV% = 
(SD x 100) / mean” formula. 

The mean of bias% separately for each month period was used 
for calculation of sigma levels. Data from EQC, were obtained 
once a month by External Quality Assurance Services (EQAS). 
Cardiac markers program BC39 was used to provide bias values 
with the mentioned formula: “Bias% = (mean of peer group - 
mean of our lab / mean of peer group) x 100”. 

TEa%’s of AAB, BV, RCPA, Ricos and Rilibak were used to cal- 
culate sigma metrics. The sigma metrics for 5 tests was calcu- 
lated by “Sigma = (TEa% — Bias%) / CV%” formula. Among three 
Radiometer AQT9O Flex analyzers, the sigma levels of the most 
used analyzer were calculated for each month. 


Results 

TEa%’s of the tests according to AAB, BV, RCPA, Ricos, and 
Rilibak were presented in Table 1. CV%'s for IQC1 and IQC2 
samples for each consecutive six months were shown in Table 
2. Bias%’s were given in Table 3 and sigma levels according to 
AAB, BV, RCPA, Ricos and Rilibak TEa%’s were given in Table 
4. The tests were divided into four groups according to their 
sigma levels. 


Table 1. TEa%’s of the tests according to AAB, BV, RCPA, Ricos and Rilibak. 


Teste AAB BV RCPA Ricos Rilibak 
TEa%  TEa% TEa% TEa% TEa% 
see 31.2% c 30.06% (S) d 
mass 
Myoglobin a b c 19.60% (S) d 
ee a b 20% (>125 ng/L) 13.00% (S) d 
proBNP : 8 a 
0.9 ng/ +0.002 up to 
Troponin | mL or b 0.010pg/L; 20% 76.36%(P) 33.00% 
30% >0.010pg/L 
0.1 ng/ +0.01 up to 
TroponinT mtLor b 0.050pg/L; 20% 48.9% (S) 33.00% 
30% >0.050pg/L 


TEa: Total allowable error; AAB: American Association of Bioanalysts, BV: 2004 
update of the Spanish Society of Clinical Chemistry and Molecular Pathology 
(SEQC) table of Desirable Quality Specifications based on Biological Variation, 
RCPA: 2012 update of the Royal College of Pathologists of Australasia and 
the Australasian Clinical Biochemist association Quality Assurance Program, 
aTEa: value is not available according to AAB. bTEa: value is not available 
according to BV, cTEa: value is not available according to RCPA, dTEa: value is 
not available according to Rilibak, S: serum, P:plasma. 


Tests having sigma levels below 3.0 are evaluated as “poor” 
and named as Group 1 tests. Group 2 tests are the ones having 
sigma levels between 3.0 and 3.99, evaluated as “acceptable”. 
Group 3 tests have sigma levels between 4 and 5.99 and named 
as “good”, whereas group 4 have sigma levels above 6 named 
as “world class quality”. For consecutive six months tests of 
groups 1,2,3 and 4 were given in Table 5. The analytical perfor- 
mance of the tests in Group 1 was poor whereas the tests in 
Group 4 had world-class analytical quality. 
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Table 2. CV%'s for |QC1 and IQC2 samples for consecutive six months. 


agnosis of cardiac disease [6,7,8]. 


For diagnosis of AMI in the emer- 


CV% 
Months Dec2017 Jan2018 Feb2018 March2018 April 2018 May2018 gency units, myoglobin is a better 
Instruments AQT902 AQT902 AQT902 AQT902 AQT901 AQT901 marker rather than CKMB mass 
Tests iacl. «1ac2)—s1ac1_—s1ac2_—s1aci_-—s tac2_—s tac. tac2,s tac. tac2_staci_-—s 1ac2_~—s or cTnT within 3-6 hours after in- 
pas jy S11 2399 5.74 248 2.79 425 404 165 361 31 365 4.06 ception of symptoms, while CKMB 
uB mass is better at 7th hours. The 
ae 2099 68 509 37 £43 275 362 305 278 274 244 363 ~~ test features are affected by the 
ieee possibility of the existence of AMI 
-p 
(ng/L) 1276 7.75 7.01 426 395 302 453 674 577 676 749 539 in the patients and by the size of 
i infarct [9]. As a result, having cor- 
Troponin! 966 63888 871 47 583 472 883 38 502 665 795 5.31 ] are 
(ug/L) rect values for all cardiac biomark- 
ae T 954 995 97 524 848 669 1039 687 1396 823 1123 944 fs are significant while clinicians 
decide about the diagnosis of car- 
Note: IQC:internal quality control, EQC: External quality control . : 
diac diseases. 
NT-proBNP was evaluated only ac- 
cording to RCPA and Ricos. In De- 
Table 3. Bias%’s calculated from EQC data. cember, both IQC level were evaluated as “poor” by RCPA and 
Tests Bias% Ricos. In January, only |QC2 was shown as “poor” by RCPA, but 
stan Dec Jan Feb March April May Ricos said “poor” for both two IQC levels. Therefore generally 
onths 
2017 2018 2018 =~. 2018 2018 2018 poor outcomes were received for Ricos and it was being evalu- 
Instruments AQT902 AQT902 AQT902 AQT9O2 AQT9O01 AQT901 ated for serum. RCPA TEa%’s were found to be suitable for our 
os mass 9.79 232 0.87 476 171 5.92 laboratory because our samples are whole blood samples. 
: Sigma levels of NT-proBNP were evaluated as “acceptable”, 
Myoglobin ° ” °, wa A 
acta 476 350 1568 1363 056 056 good” or “world-class quality” for February, March, April but 
(ug/L) 
NT-proBNP generally at one IQC level. Therefore, NT-proBNP was reported 
4.9] 8.72 1.58 1.63 1.03 2.99 it : ae 
(ng/L) as “improvement studies are required’. 
ae | é a6 ase eee ee se NT-proBNP ensures significant prognostic value for HF patients. 
(ug/L) It is important for discharge and for hospitalization of HF that 
a T 1234 ©=-33.63 «39.48 ~—S—«16.86 7.72 1.44 are robust. Additionally, it is also robust and independent factor 
ug 


Note. EQC: External quality control 


Discussion 

In order to manage vital cardiac diseases, the emergency labo- 
ratory should give test results in a short turnaround time (TAT) 
[5]. 

Laboratory experts prefer Radiometer Flex 90 hence it allows 
short TAT. At the same time, good quality test outcomes are 
also more important in the management of cardiac diseases 
in emergency units. For this purpose, analytic quality of cardiac 
biomarkers was evaluated in our emergency laboratory by six 
sigma metric. The tests were observed by dividing the tests 
into groups according to the sigma levels. The tests needed to 
be improved were identified by TEa% of AAB, BV, RCPA, Rilibak, 
Ricos. 

TEa%’s for the CKMB mass are established by only BV and Ri- 
cos. According to both Ricos and BV, CKMB mass seemed to 
have problems only at |QC2 in December. In other months, per- 
formance was at good levels, even at world-class quality stan- 
dards. 

Mb could be evaluated only according to Ricos because of Ri- 
cos gave TEa% only for Mb. In December, February, and March, 
sigma levels for both IQC levels performed poorly. In January, 
1QC1 was evaluated as acceptable, |QC2 as good quality. In 
May, 1QC2 was shown in good, IQC1 in world-class quality. In 
April, sigma levels were detected as world-class quality for Mb. 
Mb levels increase early from 90 pg/mL to 250 ng/mL within 
90 min after acute myocardial infarction (AMI), vital rapidly di- 


of all-cause death and HF rehospitalization [2, 10]. 

NT-proBNP is a significant biomarker of adverse events post- 
AMI such as death, HF and less strongly for recurrent cardiac 
ischemia [1]. 

TEa%’s of cTn | were identified as AAB 30%, RCPA 20%, Ricos 
76.36% (for plasma), Rilibak 33% excepting BV. TEa% of Ri- 
cos was very high compared to others and was reported as the 
designated value for plasma. We did not choose the TEa%’s for 
Ricos serum because our samples were whole blood samples. 
Sigma levels of cTnl for IQC2 were detected as “poor” qual- 
ity by AAB, Ricos, and Rilibak in January. According to RCPA, 
both two IQC levels showed “poor” sigma metric quality in this 
month. In December, while |QC1 of cTnl was “world-class” qual- 
ity, |QC2 was “poor” by Ricos. Consequently, only cTn! was 
world-class quality in December only according to Ricos. Sigma 
levels of IQC1 were poor in January by AAB and RCPA. However, 
when IQC1 was evaluated by Ricos, it was world class quality. 
Because of this serious difference for evaluation results, it was 
decided to use TEa% of Rilibak (33%) in our laboratory for cTnl. 
While IQC2 (in December) and IQC1 (in March) was poor, IQC1 
(in December) was evaluated as acceptable, |QC2 as good qual- 
ity (Group 3). Generally, sigma levels of cTnl were acceptable or 
more world class quality for consequent six months. 

According to the study conducted by Young et al., National Cen- 
tre of Clinical Laboratories (NCCL) of China, TEa% is taken as 
30% and sigma levels for cTn | and cTnT were calculated as 5 
and 3.8 respectively. However, NCCL study was conducted by 
using a serum. [11]. 
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Table 4. Sigma levels of the tests according to AAB, BV, RCPA, Ricos and Rilibak. 


eke Tests Sigma AAB Sigma BV Sigma RCPA Sigma Ricos Sigma Rilibak 
1QC1 1QC2 1QC1 1QC2 1QC1 1QCc2 10C1 1Qc2 1QC1 1QC2 

CKMBmass(ug/L) 5.96 1.27 5.74 1.22 
Myoglobin (ug/L) 0.70 2.18 

pee NT-proBNP (ng/L) 1.19 1.94 0.63 1.04 
Troponin | (ug/L) 3.10 0.77 2.07 0.51 7.90 1.96 3.41 0.84 
Troponin T (ug/L) 1.85 Lv 0.80 0.76 3.83 3.67 2.16 2.07 
CKMBmass(ug/L) 5.03 11.74 3.42 11.18 
Myoglobin (ug/L) 3.16 4.35 

eae NT-proBNP (ng/L) 1.60 2.64 0.61 1.00 
Troponin | (ug/L) 2.96 5.49 1.81 3.37 8.28 15.36 3.31 6.13 
Troponin T (ug/L) = - * . 1.57 2.91 * > 
CKMBmass(ug/L) 10.87 7.13 10.46 6.86 
Myoglobin (ug/L) 0.91 1.42 

hans NT-proBNP (ng/L) 4.66 6.09 2.89 3.78 
Troponin | (ug/L) 4.87 6.02 3.16 3.90 12.83 15.84 5.39 6.66 
Troponin T (ug/L) 7 i ii * 1.11 1.40 * * 
CKMBmass(ug/L) 6.54 16.02 6.26 15.33 
Myoglobin (ug/L) 1.64 1.95 

estas 8 NT-proBNP (ng/L) 4.05 2.72 2.50 1.68 
Troponin | (ug/L) 1.51 3.50 0.37 0.87 6.76 15.66 1,85 4.28 
Troponin T (ug/L) 1.26 1.91 0.30 0.45 3.08 4.66 1,55 2.34 
CKMBmass(ug/L) 8.16 9.5 7.85 9.14 
Myoglobin (ug/L) 6.84 6.94 

pr = NT-proBNP (ng/L) 3.28 2.80 2.03 1.77 
Troponin | (ug/L) 4.87 3.67 2.87 2.16 14.10 10.64 5.46 4.12 
Troponin T (ug/L) 1.59 2.70 0.87 1.49 2.94 5.00 1.81 3.07 
CKMBmass(ug/L) 6.92 6.22 6.66 5.94 
Myoglobin (ug/L) 7.80 5.24 

ae 6 NT-proBNP (ng/L) 2.27 3.15 1.33 1.85 
Troponin | (ug/L) 3.40 5.09 2.14 3.20 9.23 13.82 3.77 5.65 
Troponin T (ug/L) 2.54 3.02 1.65 1.96 4.22 5.02 2.81 3.34 


*: bias% is higher than total allowable error ratio (TEa%), sigma level of test could not be calculated. 

AAB: American Association of Bioanalysts, BV: 2004 update of the Spanish Society of Clinical Chemistry and Molecular Pathology (SEQC) table of Desirable Quality 
Specifications based on Biological Variation, RCPA: 2012 update of the Royal College of Pathologists of Australasia and the Australasian Clinical Biochemist 
association Quality Assurance Program, |QC:internal quality control, EQC: External quality control 


The main problem in terms of sigma level was seemed to be in 
cTnT. It was remarkable because generally it was of poor sigma 
quality. TEa% for cTnT was not given by BV, therefore, it could 
not be evaluated according to BV standards. The cTnT gave 
poor sigma quality for both two IQC levels in December, Febru- 
ary, and March by all evaluations except for Ricos. In January, all 
evaluation results were poor quality. In April, evaluation results 
were poor quality according to AAB and RCPA, where as only 
1QC1 was poor quality for Ricos. In May, |QC1 was poor quality 
for AAB and Rilibak, while both two IQC levels were poor quality 
for RCPA. 

The sigma levels of tests below 3 are considered as the unac- 
ceptable level of quality. TEa% is a simple comparative quality 
concept used to define acceptable analytical performance. 
However, our samples are whole blood samples and we could 
not meet TEa% for whole blood samples. The more reliable out- 
comes for our laboratory may be obtained TEa% with whole 
blood samples. The testing process runs quicker with whole 


blood samples because centrifugation and waiting for coagu- 
lation are not necessary. Therefore, it is appropriate for the 


emergency laboratory. 


Conclusion 

As a conclusion, due to using different TEa%’s for each test, 
different sigma levels were determined. On the other hand, be- 
cause of “poor quality” sigma levels for cTnT by all references, 
the decision was taken for the improvement of cTnT in our 
laboratory. In addition, it was observed that there is no speci- 
fied TEa% for whole blood samples. Therefore, it was concluded 
that, for more accurate and consistent evaluations, the speci- 
fied matrix of TEa values are required for whole blood samples. 
It may be valuable suggestion for further assessment of cardiac 


biomarkers. 
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Table 5. Group1,2,3 and 4 of tests according to sigma levels for consecutive six months by AAB, BV, RCPA, Ricos and Rilibak. ts according to sigma levels for con- 


secutive six months. 


Months-Instrument Sigma AAB Sigma BV Sigma RCPA Sigma Ricos Sigma Rilibak 
1QC1 1QCc2 1QC1 1QC2 1QC1 1QC2 1QC1 1QC2 1QC1 1QC2 
Group 1 (sigma<3 ) 
CKMB 
bel a p 
December 2017 f Troponin | CKMB i poe nT ene Myoglobin pie ' : Troponin | 
AQT902 Troponin T Troponin’ wad mace Troponin | Troponin NT-proBNP Myoglobin Troponin T Troponin T 
open Troponin T Troponin T P NT-proBNP cr 
Troponin | 
January 2018 Troponin | ‘ Troponin | NT-proBNP NT-proBNP — NT-proBNP : . 
AQT902 Troponin T Tepe Troponin T Troponin T Troponin T Troponin T Trepentny “Trepenint 
Myoglobin . 
February 2018 . F . Pees Myoglobin ; . 
AQT902 Troponin T — Troponin T Troponin T Troponin NT- proBNP Troponin T Troponin T Troponin T 
Troponin T 
= p 
March 2018 Troponin | Troponin T Troponin | Ze hee Myoglobin Nvoslebin Troponin | franoninga: 
AQT902 Troponin T P Troponin T P ee NT-proBNP yoR Troponin T P 
Troponin 
a NT-proBNP 
April 2018 ; ‘ roponin | ‘ NT-proBNP 
AQT9O1 Troponin T — Troponin T Troponin T Tropenin |) Troponin T NT-proBNP 
Troponin 
NT-proBNP 
Mey awe Troponin T Troponin | Troponin T NT-proBNP ~==NT-proBNP _ Troponin T 
AQT901 : 
Troponin T 
Group 2 (sigma: 3.0-3.99) 
December 2017 . . F 
AQT902 Troponin | Troponin T — Troponin | 
January 2018 3 CKMB mass . 
AOT9O2 Troponin | Myoglobin Troponin | 
February 2018 ‘ ‘ 
AQT902 Troponin | Troponin | NT-proBNP 
March 2018 P F 
AQT902 Troponin | Troponin T 
April 2018 ‘ 
AQT901 Troponin | NT-proBNP 
May 2018 . . NT-proBNP : . 
AOT901 Troponin! — Troponin T ‘Troponin | Troponin! Troponin T 
Group 3 (sigma: 4.0-5.99) 
December 2017 CKMB CKMBmass 
AQT902 and mass Troponin T 
January 2018 . CKMB ‘ 
AOT902 Troponin | Ne Myoglobin 
February 2018 , ‘ 
AQT902 Troponin | NT-proBNP Troponin | 
March 2018 ; : 
AOT902 NT-proBNP Troponin T Troponin | 
April 2018 . P ‘ P 
AQT9O1 Troponin | Troponin T — Troponin | Troponin | 
May 2018 , CKMBmass 
= Troponin | Troponin T Myoglobin Troponin | 
AQT901 ‘ 
Troponin T 
Group 4 (sigma: =6.0) 
December 2017 Teoponin't 
AQT902 
January 2018 CKMB CKMBmass TreponiA | 
AQT902 and mass Troponin P 
February 2018 : CKMB CKMB CKMBmass CKMBmass 
AQT902 Wepenin) andmass andmass nEpISEnE Troponin | Troponin Treponta'! 
March 2018 CKMB CKMB CKMBmass CKMBmass 
AQT902 and mass and mass Troponin | Troponin 
April 2018 CKMB —-CKMB ies pees 
AQT901 and mass andmass ye P vos : 
Troponin | Troponin 
May 2018 CKMB.—sCKMB ieee oan 
AQT901 and mass andmass YOR ‘ ay 
Troponin | 
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